Motion recognition using local auto-correlation of space-time gradients

0167-8655/$ see front matter 2012 Elsevier B.V. A http://dx.doi.org/10.1016/j.patrec.2012.01.007 ⇑ Corresponding author. Tel.: +81 29 861 5491; fax E-mail addresses: [email protected] (T. (N. Otsu). In this paper, we propose a motion recognition scheme based on a novel method of motion feature extraction. The feature extraction method utilizes auto-correlations of space–time gradients of threedimensional motion shape in a video sequence. The method effectively exploits the local relationships of the gradients corresponding to the space–time geometric characteristics of the motion. For recognizing motions, we apply the framework of bag-of-frame-features, which, in contrast to the standard bag-of-features framework, enables the motion characteristics to be captured sufficiently and the motions to be quickly recognized. In experiments on various datasets for motion recognition, the proposed method exhibits favorable performances as compared to the other methods, and faster computational time even than real time. 2012 Elsevier B.V. All rights reserved.